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(54) Dynamic management of embedded coded images in a digital storage device 



(57) An embedded coding scheme is used to 
dynamically changes the size of compressed images 
and as a result image quality according to the number of 
stored pictures. As more images are captured, the 
image storage device makes room for newly captured 
images by truncating existing compressed embedded 



coded bitstreams of previously stored images. The 
embedded digital image storage device can thus store a 
virtually unlimited number of images by dynamically 
trading-off between the number of stored images and 
image quality. 
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Description 
BACKGROUND OF THE I 



r^ftiON 



[0001 ] This invention relates to storing images in an 
image storage device and more particularly to dynamic 
management of embedded coded images. 
[0002] Image compression using current JPEG 
standards can reduce the number of bits required to 
store the digitized images by encoding and quantizing 
the images at certain compression ratios. The com- 
pressed images use less memory but have the disad- 
vantage of lowering image quality. Because each image 
is compressed at the same compression ratio, each 
image has the same image quality regardless of the 
amount of available memory in the image storage 
device. 

[0003] Memory storage devices, such as digital 
cameras, can only store a limited number of pictures in 
a regular^quality mode and can store even fewer pic- 
tures in a high<|uality mode. The number of stored pic- 
tures is usually fixed for each mode. If memory in the 
storage device is full, newly captured images must 
either be discarded or previously stored images must be 
discarded to make room for the new images. 
[0004] A user may want the option to take only one 
picture at the highest possible image quality or the 
option of taking multiple pictures at lower image quality. 
If the first pictures taken are compressed to conserve 
memory space, it is not then possible to convert these 
compressed images to a higher image quality, even if 
only one or two pictures are ever taken. 
[0005] Accordingly, a need remains for a simple 
dynamic memory management system that maintains 
the highest possibly image quality for the number of 
images currently stored in memory. 

SUMMARY OF THE INVENTION 

[0006] The invention utilizes an embedded coding 
scheme to dynamically change the size of compressed 
images according to the number of stored pictures. A 
storage-limited device, such as digital camera, captures 
and converts images into embedded bitstreams. The 
images are initially stored as high quality images at low 
compression ratios to fully utilize available memory. 
[0007] Room for a newly captured image is pro- 
vided by truncating the existing embedded coded bit- 
streams of the previously stored images. The newly 
captured image is then encoded to fit into the space 
truncated from the currently stored images. The image 
storage device stores a virtually unlimited number of 
images by dynamically trading-off between the number 
of stored images and the image quality of each image. 
[0008] Bitstreams encoded using an embedded 
image coding scheme can be truncated at arbitrary 
locations. As a result, the number and size of images 
stored in the memory device can be adaptively adjusted 



without having to decode and reencode the existing 
stored images. The a^Aof memory allotted for each 
stored image can theWrmore easily and quickly var- 
ied according to the available memory space. 
5 [0009] The foregoing and other objects, features 
and advantages of the invention will become more read- 
ily apparent from the following detailed description of a 
preferred embodiment of the invention, which proceeds 
with reference to the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0010] 

FIG. 1 is a schematic diagram showing how embed- 
ded coded images are dynamically allocated mem- 
ory according to the invention. 
FIG. 2 is a block diagram of an image storage 
device using the dynamic memory allocation shown 
in FIG. 1. 

FIG. 3 is a flow diagram showing how a memory 
management system operates in the image storage 
device of FIG. 2. 

FIGS. 4 and 5 are schematic diagrams showing one 
example of how compressed images are truncated. 

DETAILED DESCRIPTION 



[0011] A memory 12 is shown with different config- 

30 urations 12A-12D of stored images according to the 
invention. Memory 12 in configuration 12A stores a sin- 
gle image #1 that has been compressed into an embed- 
ded bitstream using an embedded encoder 11. The 
coarseness (image quality) of the image depends on 

35 the memory available. 

[0012] The embedded coded bitstream for image 
#1 is generated in the order of information significance. 
In other words, the bitstream is encoded so that the 
most significant bits for each coefficient are sent first 

40 then followed by the next most significant bits of each 
coefficient, etc. Embedded coding allows the bitstream 
to be truncated at any point and still maintain the most 
significant image information with the remaining bits. 
Thus, even a highly truncated image bitstream can pro- 

45 vide a coarse representation of the image. 

[0013] One embedded coding technique that can 
be used in the embedded coder 1 1 is Rate<Jistortion 
Optimized Embedded (RDE) coding. This technique is 
disclosed in U.S. Patent Application Serial No. 

so 09/016,571, "An Embedded Image Coder with Rate- 
Distortion Optimization", filed January 30, 1998, by J. Li 
and S. Lei, which is incorporated herein by reference. 
However, the invention can be implemented with any 
embedded coding scheme that allows arbitrary trunca- 

55 tion of an image bitstream. Embedded coding tech- 
niques currently exist for wavelet-based coding 
algorithms and for Discrete Cosine Transform (DCT)- 
based coding algorithms and are therefore not 
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described in detail. 

[001 4] Since the en^^Bbmory 1 2 is initially empty, 
image #1 may not hav^Pfe truncated at all or may 
only have to be truncated a small amount (small com- 
pression ratio). Image #1 therefore maintains high 5 
image quality when decoded and displayed from the 
memory configuration 12A. Memory 12 might have 
room to store more than one entire nontruncated image 
at the same time. For illustrative purposes, image #1 is 
shown completely filling memory 12. w 
[0015] When a second image #2 is stored in the 
memory configuration 12B, the least significant portion 
14 of previously stored image #1 is truncated to make 
room for the new image #2. Image #2 is encoded by 
embedded encoder 11 by an amount necessary to fit 15 
into the space 14 made available by truncating the bit- 
stream of image #1 . For example, the least significant 
half of the image information for image #1 is truncated. 
The most significant half of the image information for 
image #2 is then stored in the truncated space 1 4 from 20 
image #1. 

[0016] The stored images are further truncated 
each time another image is received by the image stor- 
age device. For example, the least significant portion 1 6 
of the embedded bitstream for stored image #1 is trun- 25 
cated again in memory configuration 12B to make room 
for a third image #3. The least significant portion 18 of 
the embedded bitstream for image #2 is also truncated 
in memory configuration 1 2B to make room for a portion 
of the embedded bitstream for image #3. 30 
[001 7] For example, if the incoming image is image 
#2, the memory manager 22 may truncate image #1 to 
truncate it to 1/2 of its original size. If image #1 is a 512 
pixels by 51 2 pixels color image, with 24 bits per pixel (8 
for each color), the overall image size is 512 x 512 x 3 35 
in bytes (8 bits per byte). This equals 786,432 bytes. 
The memory manager 22 may truncate this to 1/2 its 
size, or 393,216 bytes. The truncation process essen- 
tially throws away the data for half the image. The data 
is organized in the memory 12 such that the more 40 
important information bytes are stored at the front of the 
memory for that memory 12. The truncation process 
works from the opposite end of the memory. 
[0018] If no more images are taken by the user, the 
two images remain truncated to this level. If the user 45 
takes another picture, the memory manager could trun- 
cate the previously stored images #1 and #2 in several 
ways. In one possible approach, the images #1 and #2 
could be truncated to 1/3 of their original size. This 
would reduce them to 262, 1 44 bytes. This then frees up so 
the same number of bytes for image #3. In this manner, 
each of the stored images is reduced by the same 
amount. 

[0019] A user, therefore, has the option to take 
fewer high quality images with little or no truncation ss 
(memory configuration 12A) or more lower quality 
images with a higher compression ratio (memory con- 
figurations 12B or 12C). Because the images #1 , #2 and 



#3 are encoded int^^jbedded bitstreams, each image 
can be arbitrarily t^Bted at the end to make room for 
additional images.^Rnange compression ratios using 
other compression techniques, the stored images would 
first have to be decoded, then requantized and then 
reencoded at the higher compression ratio. The recom- 
pressed images would then have to be restored into 
memory 12. The embedded encoding technique 
described above allows less complex memory manage- 
ment system to dynamically allocate memory for new 
images. 

[0020] Dynamic memory allocation according to the 
invention is used with a variety of different user selecta- 
ble image storage options. For example, a user can 
select one or more exiting stored images to be replaced 
with a new image. Images #1 and #2 in memory config- 
uration 12C, for example, are selected to be replaced 
with the encoded bitstream for a new image #4 in mem- 
ory configuration 12D. Because image #4 is encoded 
into an embedded coded bitstream, the bitstream for 
image #4 is easily truncated to the size necessary to fit 
into the memory space previously occupied by images 
#1 and #2. The user has selected images #1 and #2 for 
complete truncation, which essentially means that all of 
the image information is to be removed from the mem- 
ory 12. The sizes of images #1 and #2 may have been 
1/3 of the overall memory, or 1/3 of an originally cap- 
tured, non-truncated image, 262,144 bytes as dis- 
cussed previously. Therefore, image #4 has twice that 
amount, 524,288 bytes, allowing it to be saved with 
greater image quality. Because, the user selected two 
images #1 and #2 for replacement, image #4 is trun- 
cated less than image #3 and, in turn, retains more 
image resolution (higher image quality). 
[0021] A user may also select a maximum trunca- 
tion threshold value for one or more of the images. For 
example, image #4 can be selected by the user not to 
be truncated beyond that shown in memory configura- 
tion 12D. Nonselected images such as image #3, and 
subsequently stored images are then truncated equally 
to make room for newly acquired images. A second 
maximum truncation threshold value can be configured 
into the system to automatically prevent the stored 
images from being truncated below some minimum 
image quality level. 

[0022] Referring to FIG. 2, a memory manager 22 
according to the invention is integrated into an image 
storage device, such as a digital camera 19. The same 
memory manager 22 is adapted for integration into 
other image storage devices such as personal comput- 
ers. A camera 20 captures images 21. An embedded 
coder 1 1 receives digitized images from the camera 20. 
The embedded coder 1 1 encodes and truncates the 
received images according to a file size specified by the 
memory manager 22. The truncated encoded images 
are stored in memory 12 at memory locations specified 
by memory manager 22. User image selections are 
received by an user image selector 28 and fed to the 
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memory manager 22. User i mage selector 28 allows the 
user to select images for rea^feient with new images, 
limit truncation for selected n^ps, etc. 
[0023] The user through user image selector 28 
selects one or more of the images in memory 1 2 for dis- s 
play. The memory manager 22 sends the selected 
image from memory 12 to decoder 24. Decoder 24 
decodes the truncated embedded coded image and 
then outputs the decoded image to a display 26. The 
embedded coder 11 and decoder 24 can be imple- 10 
mented using any one of a variety of existing embedded 
coding schemes, such as the Rate-Distortion Optimized 
Embedded (RDE) coder described above. 
[0024] FIG. 3 is a flow diagram describing in more 
detail how the memory manager 22 operates. The 15 
memory manager 22 is initialized in step 30 with a max- 
imum truncation value. Images cannot be truncated 
beyond this maximum truncation value preventing the 
stored images from being truncated below some mini- 
mum image quality level. 20 
[0025] For example, the user may designate a 
threshold by truncation ratio or the amount of used 
memory. If the user were to designate that the trunca- 
tion threshold is a truncation of not less that 10:1, the 
786,432 bytes of an originally captured, non-truncated 25 
image could not be truncated to less than 78,643 bytes. 
If the memory of the capture device is 1 Megabyte 
(1 ,024,000 bytes) the user could not capture more than 
thirteen images. The user could also designate the 
each image cannot be truncated such that they use less 30 
than 1/12 of the image. 

[0026] As mentioned previously, the user can also 
designate truncation values for a given image. The des- 
ignated image is then held at the current truncation level 
and the non-designated images are truncated accord- 35 
ingly to make room for the new images. The images are 
received in step 32 and embedded coded in step 34. 
Decision step 36 determines if there is memory availa- 
ble to store a newly received image. If sufficient memory 
is available, the image is stored in step 38. The memory 40 
manager 22 then waits to receive the next image in step 
32. 

[0027] If there is insufficient memory, decision step 
40 first determines if there has been any previous user 
input that has tagged any previously stored images for 45 
replacement. If the user has selected to replace one or 
more previously stored images, step 44 truncates the 
received image, if necessary, to fit into the space of the 
selected images. Step 46 then replaces the selected 
images in memory with the newly received image. so 
[0028] If the user does not select any stored images 
for replacement, stored images are truncated in step 42. 
The memory manager 22 can truncate images specifi- 
cally selected by the user through the user image selec- 
tor 28. Fa example, the user may designate certain 55 
images that are less important to the user than others. 
Those tagged images are then truncated at some level 
to make room for new images. If the user wants to cap- 



ture and save 4 new images, the user may select 4 
images of lesser imf^^^e through the user image 
selector 28. These foHmages are then truncated to 
make room for the new images. 
[0029] Alternatively, all the images are all truncated 
equally when the user does not select any stored 
images for truncation. The newly received encoded 
image is truncated in step 48 to fit into the memory 
space made available by truncating the previously 
stored images. The memory manager 22 stores the 
newly received image in memory in step 50 and then 
returns to step 32 to receive the next image. 
[0030] Referring to FIGS. 4 and 5, the memory 
manager 22 dynamically truncates the multiple images 
in memory 12. In one example, the memory manager 
22 truncates the stored images using a directory index- 
ing scheme similar to that used to locate files on a per- 
sonal computer hard disk. A directory 52 identifies the 
images currently stored in memory. Each entry in direc- 
tory 52 includes a pointer 55 to a beginning memory 
block section 54 for one of the stored images. Each 
memory block section 54 also has an associated pointer 
56 that indicates the next memory block section con- 
taining another portion of the same image. The last 
memory block section 54 for each image is identified 
with an End of File (EOF) tag 58. 
[0031] FIG. 4 shows a variable number of images 
#1 - #N already stored in memory 12. Stored images #1 
- #N each has multiple memory block sections #1 - #N. 
FIG. 5 shows how the existing stored images #1 - #N 
are dynamically truncated to allow storage of an addi- 
tional image #N+1 . Referring to FIG. 5, an entry 52A is 
added to directory 52 for the new image #N+1 . The EOF 
tags 58 are moved up one or more memory block sec- 
tions in each one of the currently stored images #1 - #N. 
Specifically, the EOF tags 58 moving up will essentially 
free up the memory blocks that previously had con- 
tained image information prior to the EOF tag 58. The 
memory blocks #1 -#N for each image prior to truncation 
had the EOF tag 58 in block #N. The pointers could be 
changed to move the EOF tag 58 to memory block #N- 
2, making each image have two less memory blocks. As 
these memory blocks are no longer pointed to by the 
pointers, the memory allocated becomes free memory. 
For illustration purposes, the EOF tags 58 for images 
#1- #N are each moved up one from the last memory 
block section #N to the next to last memory block sec- 
tion #N-1. 

[0032] The directory pointer 55A for new received 
image #N+1 points to the memory block section 60 that 
was previously the last memory block section for image 
#1. A pointer 62 for memory block section 60 points to 
the truncated memory block section 64 previously linked 
to image #2. The remaining pointers 62 for the newly 
received image #N+1 link to the memory block sections 
that previously were the last links in the previously 
stored images. The embedded bitstream for image 
#N+1 is then stored in the truncated memory block sec- 
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tions 60, 64, 66, etc. Othen existing memory manage- 
ment schemes can s'^^f be used to track the 
beginning and ending >^Prn of truncated images in 
the image storage device. 

[0033] Having described and illustrated the princi- s 
pies of the invention in a preferred embodiment thereof, 
it should be apparent that the invention can be modified 
in arrangement and detail without departing from such 
principles. I claim all modifications and variation coming 
within the spirit and scope of the following claims. 10 

Claims 

1. A system for managing the storage of multiple 
images (21) in an image storage device, compris- 15 
ing: 

an embedded coder (1 1) encoding the images 

into embedded encoded bitstreams; 

memory (12) storing the encoded bitstreams 20 

for the multiple images (21); and 

a memory manager (22) truncating the stored 

embedded encoded bitstreams and storing 

embedded encoded bitstreams for newly 

acquired images into the memory freed by 25 

truncation of the stored embedded encoded 

bitstreams. 

2. A system according to claim 1 wherein the image 
storage device comprises a digital camera (20). 30 

3. A system according to claim 1 wherein the memory 
manager (22) stores additional newly acquired 
images in the memory (12) by dynamically increas- 
ing the amount of truncation for each one of the 35 
stored images and storing the additional newly 
acquired images in the memory (12) freed from 
truncation of the stored images. 

4. A system according to claim 3 wherein the memory 40 
manager (22) truncates each one of the stored 
images by about the same amount. 

5. A system according to claim 1 wherein the memory 
manager (22) includes an image selector (28) that 45 
tags images and then truncates the stored embed- 
ded coded bitstreams of the tagged images. 

6. A system according to claim 1 wherein the memory 
manager (22) is initialized with an image truncation 50 
value that limits how much each stored image is 
truncated. 

7. A system according to claim 1 wherein the embed- 
ded coder (11) comprises a Rate-Distortion Opti- 55 
mized Embedded (RDE) coder. 

8. A system according to claim 1 including a decoder 



(24) coupled tc^je memory for decoding the trun- 
cated embed^Axied bitstreams for the stored 
images. 

9. A system according to claim 8 including a display 
(26) coupled to the decoder (24) for displaying the 
decoded images. 

1 0. A system according to claim 1 wherein the memory 
manager (22) includes a directory of images stored 
in memory (12), the memory manager (22) truncat- 
ing the stored images by changing pointers (55) 
that identify which blocks (54) in memory (12) are 
linked to the stored images. 

11. A method for dynamically changing the size and 
image quality of compressed images in a storage 
device: 

capturing one or more images (21); 
encoding the captured images (21) into com- 
pressed low-compression ratio bitstreams 
using an embedded coding scheme; 
storing the images (21) at the low compression 
ratio when there are only a few number of 
stored images; and 

truncating the compressed bitstreams for the 
stored images only as much as necessary to 
make room for newly captured images to mini- 
mize loss of image quality for the stored 
images. 

12. A method according to claim 11 wherein the 
embedded coding scheme allows arbitrary trunca- 
tion of he compressed bitstreams without having to 
decode and reencode the stored images. 

13. A method according to claim 1 1 wherein the stored 
images and the newly captured images are trun- 
cated only as much as necessary to fully fit the 
available storage space in the storage device. 

14. A method according to claim 11 including com- 
pressing the newly captured images to fit into mem- 
ory space truncated from the stored images. 

15. A method according to claim 11 including the fol- 
lowing: 

selecting one or more of the stored images 
completely truncating the selected images; 
truncating the newly captured image to a same 
size as the selected truncated images; and 
replacing the selected truncated images with 
the truncated newly captured image. 

16. A method according to claim 1 1 including selecting 
a truncation threshold value and automatically trun- 
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eating stored images to make room for the newly 



17. A method according to claim 11 including the fol- 5 
lowing: 

storing the images in multiple memory block 
sections (54); 

linking the memory block sections (54) for the 10 
same images together with pointers (56); 
truncating the stored images by removing the 
pointers (56) that link to one or more least sig- 
nificant memory block sections in each one of 
the stored images; and is 
storing the newly acquired images in the mem- 
ory block sections (54) that are no longer linked 
to the stored images. 
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